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Discussion 

The  purpose  of  this  report  is  to  give  an  accounting  of  the 
efficiency  and  reliability  of  the  sample  statistics  derived 
from  the  Langlie  Sensitivity  Test  using  the  maximum  likelihood 
method  in  obtaining  an  average  penetration  velocity  (V50)  and 
a standard  deviation  of  the  penetration  velocity. 

The  assumption  is  made  that  the  probability  of  obtaining 
a penetration  is  distributed  as  the  cumulative  normal  proba- 
bility distribution.  The  maximum  likelihood  method  in  theory 
will  give  the  most  likely  estimates  of  the  average  and  standard 
deviation  of  this  normal  curve.  > 

The  test  procedure  begins  with  estimates  of  those  levels 
at  which  failure  and  success  have  highly  likely  probabilities 
of  occurrence.  These  estimates  have  little  credibility.  If 
they  were  good  estimates,  the  test  would  not  have  to  be  conducted. 
This  report  shows  the  expected  results  with  estimates,  referred 
to  as  gates,  of  varying  size  around  the  true  average. 

■^The  Langlie  Test  Procedure  is  defined  in  detail  in  Appendix  A. 
A computer  program  was  prepared  simulating  test  results  using 
this  procedure.  The  true  population  was  defined  as  being  a 
ciomulative  normal  distribution  with  an  average  of  zero  and  a 
standard  deviation  of  one.  Each  of  the  sample  distributions 
shown  were  derived  by  using  different  starting  estimates  in 
terms  of  the  standard  devi-ition. 

Hopefully,  these  tables  will  provide  insight  in  the  use 
and  application  of  this  procedure. 


1 


II . Sample  Statistics:  Maximum  Likelihood  Method 


Most  of  this  section  is  devoted  to  computer  printouts  of 
distributions  of  sample  averages  and  sample  standard  deviations. 
An  attempt  was  made  in  Figure  2-1  to  summarize  some  of  the 
accumulated  data.  It  is  the  author's  opinion  that  the  summary 
hides  much  of  the  information  contained  in  the  printouts 
because  the  distributions  do  not  conform  to  standard  proba- 
bility distribution  curves,  therefore  although  these  printouts 
are  bulky,  they  are  included. 

The  author  has  been  advised  by  Ms.  Kodat^  of  Aberdeen 
Proving  Ground,  that  the  standard  deviation  (for  the  standard 
test)  should  be  divided  by  .745  in  order  to  unbias  the  results. 

From  Figure  2-1,  it  is  noted  that  as  the  initial  gates 
get  closer  the  variation  or  standard  deviation  of  the  standard 
deviation  increases  per  unit  average  standard  deviation  (under 
Standard  Deviation,  see  Standard  Deviation/Average) . The 
statistics  were  obtained  from  the  grouped  data  on  the  printouts. 
It  is  assumed  that  part  of  the  reason  the  Average  of  the 
estimated  averages  all  tend  to  be  negative  is  that  the  estimates 
that  are  exactly  zero  are  in  the  group  labeled  -.10  to  .dO  and 
that  some  of  the  tables  were  computed  using  the  same  random 
number  set. 

As  stated  previously,  these  tables  were  generated  to 
provide  some  insight  in  the  analysis  of  sample  estimates  of 
penetration  data  to  the  user  of  the  Langlie  Test  Procedure. 

Some  applications  are  discussed  in  Section  VIII  of  this  report. 


A.  Author  of  the  modified  computer  program  used  to  calculate 
the  maximum  likelihood  average  and  standard  deviation. 


Selected  Summary  of  Computer  Printouts 


Initial 

Estimates 

(In 

standard 

deviations 

-5 

-2 

-2 

-1 

0 

-0.5 

to 

to 

to 

to 

to 

to 

+5 

+3 

+2 

+2 

+2 

+0.5 

Averages 


Average 

-.01 

-.01 

-.03 

-.03 

-.05 

-.04 

Standard  Deviation 

.40 

.39 

.39 

.38 

.61 

.42 

Number  of  values 
used  from  printout 

8;^9 

827 

8|6 

849 

467 

757 

Number  of  extreme 
values  not  used 

0 

0 

0 

1 

21 

4 

Standard  Deviations 

Average 

.77 

.69 

.71 

.61 

.77 

.39 

Standard  Deviation 

.42 

.38 

.51 

.49 

.85 

.47 

Number  of  values 
used  from  printout 

^9 

825 

884 

844 

463 

753 

Number  of  extreme 
values  not  used 

0 

2 

2 

6 

25 

8 

Standard 

Deviation/Average 

.55 

.70 

.72 

.80 

1.10 

1.21 

Total  Simulations 

Attempted 

1000 

1000 

1000 

1000 

1000 

1000 

Number  of  simulations 
not  used  due  to 

No  overlap 

135 

95 

65 

53 

68 

52 

Iterative  process 
failed 

36 

78 

49 

97 

444 

187 

Fig.  2-1 
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the  data  represented  below  has  a true  ^/S0  OE  0.0  AND  A TRUE  STANDARD  DEVIATION  OF  1.0.  A SIMULATED  LANGLIE  SENSITIVITY 
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ANO  * TRUF  STANDARO  DEVIATION  OF  l.i  A SIMULAlFn  LANGLIE  SENSITIVIT 
Sr  - rMF  M+FFIMyM  AND*  M<Hf1MUM-pA-TeS-^rt-H€ Oir&O— AND ?j00'  RF5Pe€-T-I-VFE-¥v 


HUUPFR  OF  TIMFS  IN  1000  IN  WHICH 

A.  THFRE  WAS  NO  OVERLAP 
P.  ITERATIVE  PROCESS  FA 


III.  Sample  Statistics:  Five  Percent  Random  Malfunction  Rate 

In  this  section  data  is  presented  with  the  same  assumptions 
as  in  Section  II  except  that  it  is  assumed  that  there  exists  a 
random  five  percent  malfunction  rate  which  can  occur  at  any 
velocity  level. 
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THE  0AT4  PrPRESFNTED  BELOW  HAS  A TRUE  «S0  OF  0.0  AMO  A TRUF  STANOARO  DEVIATION  OF  1.0.  A SIMULATFO  LAMGLIE  SENSITIVITY 
TEST  WAT  PFRFORMFO  USING’  SAMPLES  “OF  12.’  lOO’D  TIRES.-  THE  MINIMUM  ANU  MATCTHUM’CTTrES’^WFRE — ^rOO  AMp- T.rtO-RESPECTTVELT-.’- 
THF  sample  PARAMETER  O I STR I PUT  IONS  ARE  SHOWN  RELOW. 


NUMBER  OF  TIMES  IN  lOOO  IN  WHICH 

’ ■ A.  "THERE  HAT  NU  nVERLSP ^ 5A 

R.  ITERATIVE  PROCESS  FAILED-  11« 


IV.  Sample  Statistics : Ten  Percent  Random  Malfunction  Rate 


In  this  section  data  is  presented  with  same  assumptions  as 
in  Section  II  except  that  it  is  assumed  that  there  exists  a 
random  ten  percent  malfunction  rate  which  can  occur  at  any 
velocity  level. 
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V.  Sample  Statistics;  Least  Squares  Fit  of  Ctjmulative  Normal 

Probability  Distribution 

An  alternative  method  of  eSctimating  the  average  and  standard 
deviation  was  used  vjith  the  hope  that  it  would  produce  better 
estimates.  Although  theoretically  a least  squares  fit  should  not 
give  better  results,  it  was  felt  that  within  the  narrow  constraints 
of  our  sample  space  a better  estimate  could  be  made. 

Two  sample  distributions  were  run.  The  printouts  are  shown 
in  the  figures  following.  The  results  were  sufficiently  poor 
in  comparison  to  the  maximxim  likelihood  method  that  further 
study  was  abandoned. 
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VI.  Sample  Statistics;  Least  Squares  Linear  Fit  for  Average 

followed  by  Least  Squares  Fit  of  Cumulative  Normal 

Probability  BVS&wlnlwr  for  Standard  Deviation 


Hopefully,  within  the  narrow  constraints  of  the  Standard 
Langlie  Test  Procedure  another  method  may  be  of  value  in 
estimating  the  average  and  standard  deviation  rather  than  the 
maximirai  likelihood  method.  The  method  attempted  here  used  a 
least  squares  linear  fit  of  the  data  to  determine  the  average 
This  average  was  then  used  in  the  determination  of  a standard 
deviation  which  would  minimize  the  sum  of  squared  deviations 
for  a ciomulative  normal  distribution  curve.  This  method  has 
some  merit  in  comparison  with  the  maximum  likelihood  method. 
The  sample  distributions  are  shox^m  on  the  following  page. 
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TmIS  nalA  was  OENEPATFO  USINr,  a i.FAST  SOUARES  TREND  LINE  TO  EStlnaTE  VSO  AND  A 
least  squares  NQP-JAL  DlSTPIH-iT  ion  AROUND  IT  TO  ESTIMATE  THE  STANDARD  DEVIATION 
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Comparison  of  Three  Estimatine  Methods 


On  the  following  pages  gross  comparisons  of  the  three 
estimating  methods  attempted  are  made.  In  general,  the  standard 
method  of  maximtim  likelihood  is  best,  although  there  are  times, 
as  shown  in  Figure  7-1,  when  the  maximtim  likelihood  computer 
program  does  not  give  answers  while  the  method  described  in 
Section  VI  does. 


Comparison  of  Methods  Used  to  Estimate  the 
Average  and  Standard  Deviation 


Initial  Guesses  (In  Standard  Deviations) 
0 to  +2 

Maximum  Least  Squares 

Likelihood  Linear  Average 

and  Least  Squares 
Normal  Std,  Dev. 


Averages 


Average 

-.05 

.09 

Standard  Deviation 

.61 

.51 

Number  of  Values 
used  from  printout 

467 

865 

Number  of  extreme 
values  not  used 

21 

33 

Standard  Deviations 

Average 

.77 

.57 

Standard  Deviation 

.85 

.57 

Number  of  Values 

used  from  printout 

463 

858 

Number  of  extreme 
values  not  used 

25 

40 

Standard  Deviation/ Average 

1.10 

1.00 

Total  Simulations  Attempted 

1000 

1000 

Number  of  simulations 
not  used  due  to 

No  overlap 

68 

81 

Iterative  process  failed 

444 

21 

Fig.  7-1 


Comparison  of  Methods  Used 

to  Estimate  the 

Average 

and  Standard 

Deviation 

Initial  Guesses  (In  Standard  Deviations) 

-1  to  f2 

Maximum 

Least  Squares 

Averages 

Likelihood 

Linear  Average 
and  Least  Squares 

Normal  Std.  Dev. 

Average 

-.03 

.06 

Standard  Deviation 

Number  of  Values 

.38 

.39 

used  from  printout 

Number  of  extreme 

849 

933 

values  not  used 

Standard  Deviations 

1 

6 

Average 

.61 

.62 

Standard  Deviation 

Number  of  Values 

.49 

.53 

used  from  printout 

Number  of  extreme 

844 

930 

values  not  used 

6 

9 

Standard  Deviation/Average 

.80 

.85 

Total  Simulations  Attempted 

Number  of  simulations 
not  used  due  to 

1000 

1000 

No  overlap 

53 

60 

Iterative  process  failed 

97 

1 

Fig.  7-2 


Comparison  of  Methods  Used  to  Estimate  the 
Average  and  Standard  Deviation 

Initial  Guesses  (In  Standard  Deviations) 

-2  to  +2 

Maximum  Least  Squads  Unconstrained 

Likelihood  Linear  Average  Least  Squares 

and  Least  Square  Normal  Distri- 

Normal  Std.  Dev.  bution 


Averages 


Average 

-.03 

.01 

.21 

Standard  Deviation 

.39 

.40 

. 65 

Number  of  values 
used  from  printout 

886 

935 

46 

Number  of  extreme 
values  not  used 

0 

0 

0 

Standard  Deviations 


Average 

.71 

.72 

.81 

Standard  Deviation 

.51 

.55 

.98 

Ntimber  of  values 
used  from  printout 

884 

933 

45 

Number  of  extreme 
values  not  used 

2 

2 

1 

Standard  Deviation/ 

Average 

.72 

.76 

1.21 

Total  Simulations  Attempted 

1000 

1000 

50 

Number  of  simulations 
not  used  due  to 

No  overlap 

65 

65 

2 

Iterative  process  failed 

49 

0 

2 

Fig.  7-3 


Comparison  of  Methods  Used  to  Estimate  the 
Average  and  Standard  Deviation 

Initial  Guesses  (In  Standard  Deviations) 


-5  to  +5 

Maximum  Least  Squares  Unconstrained 

Likelihood  Linear  Average  Least  Squares 

and  Least  Squares  Normal  Distri- 
Normal  Std.  Dev.  bution 


Averages 


Average 

-.01 

.02 

.07 

Standard  Deviation 

,40 

.42 

77 

Number  of  values 
used  from  printout 

0 

888 

41 

Number  of  extreme 
values  not  used 

0 

0 

Standard  Deviations 

Average 

.77 

.84 

.49 

Standard  Deviation 

.42 

.51 

.64 

Number  of  values 
used  from  printout 

888 

41 

Number  of  extreme 
values  not  used 

0 

0 

0 

Standard  Deviation/ 

Average 

.55 

.61 

1.31 

Total  Simulations  Attempted 

1000 

1000 

50 

Number  of  simulations 
not  used  due  to 

No  overlap 

135 

112 

5 

Iterative  process  failed  36 

0 

4 

Fig.  7-4 


VIII.  Applications  of  Derived  Statistics 

Shown  below  are  txvo  examples  using  the  derived  statistics. 

1.  Given  that  an  ammunition  item  has  a true  average  pene- 
tration velocity  of  800  and  a standard  deviation  of  60,  what  is 
the  best  estimate  of  the  lowest  sample  average  that  can  be  obtained 
with  90%  confidence.  It  is  assumed  the  upper  and  lower  gates  are 
680  and  920. 

Convert  the  upper  and  lower  limit  to  standard  deviations  by 
taking  the  differences  from  the  mean  and  dividing  by  the  standard 
deviation.  This  gives  values  of  -2.0  and  2.0.  Look  up  the  graph 
on  Fig.  2-16.  The  90%  confidence  level  vjill  be  indicated  by  that 
point  on  the  graph  which  has  10  percent  or  less  chance  of  occurrence. 
This  value  in  standard  deviations  is  roughly  -.5.  Multiplying  this 
number  by  the  standard  deivation  and  summing  with  the  average  gives 
the  solution  as  770. 

2.  Given  the  same  problem  as  above  but  asstiming  a 10%  random 
malfunction  rate.  Look  up  graph  on  Fig.  4-6.  The  value  in  standard 
deviations  is  roughly  .45,  giving  a solution  of  773.  A higher 
velocity  which  will  yield  a lower  effective  range. 
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PROCEDURES  FOR  DETERMINING  THE  AVERAGE  (V3Q) 


1.  Establish  a lower  and  upper  velocity  such  that: 

a.  The  probability  of  obtaining  a complete  penetration  at 
the  higher  velocity  is  highly  likely. 


b.  The  probability  of  obtaining  a complete  penetration  at 
thf  lower  velocity  is  highly  unlikely. 


2.  Fire  the  first  round  at  a velocity  midway  between  these 
two  limits. 


3.  If  the  first  round  results  in  a/^c^LpSniiBu penetration,  fire  the 
second  round  halfway  between  the  first  round  velocity  and  the 
upper  limit  velocity;  otherwise,  halfway  between  the  first  and 
lower  limit  velocity. 


4.  If  the  first  two  rounds  result  in  a reversal  (one  partial, 
one  complete) , fire  the  third  round  midway  between  the  velocity 
of  the  first  two  rounds.  If  the  first  two  rounds  result  in  two 
partials,  fire  the  third  round  at  a velocity  midway  between  the 
second  round  velocity  and  the  tXpper^  limit  velocity.  If  the 
first  two  rounds  result  in  two  completes,  fire  the  third  round 
midway  between  the  second  round  velocity  and  the  4l^Jf\ft£J^limit 
velocity. 

5.  Succeeding  rounds  are  fired  using  the  following  rules: 

a.  If  the  preceding  pair  of  rounds  resulted  in  a reversal 
(one  partial,  one  complete),  fire  at  a velocity  midway  between 
them. 


b.  If  the  last  two  rounds  did  not  produce  a reversal, 
look  at  the  last  four  rounds.  If  the  number  of  completes  and 
partials  are  equal,  fire  the  next  round  midway  between  the 
velocity  of  the  first  and  last  round  of  the  group.  If  the  last 
four  did  not  produce  equal  numbers  of  partials  and  completes, 
look  at  the  last  six,  eight,  etc.,  until  the  number  of  partials 
and  completes  is  equal.  Always  fire  at  a velocity  midway 
between  the  first  and  last  round  of  the  group  you  examined. 

c.  In  the  event  that  conditions  in  b above  cannot  be 
satisfied,  if  the  last  round  resulted  in  a complete,  fire  the 
next  round  at  a velocity  midway  between  the  last  round  and  the 
4j^r  velocity  limit;  otherwise  (last  round  is  a partial)  midwar 
between  the  velocity  of  the  last  round  and  the  Upper  limit. 
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d.  Proceed  as  in  a and  b above. 

e.  Firing  will  terminate  when  12  rounds  have  been  fired. 

f.  In  the  event  that  the  firing  does  not  produce  a zone  of 
mixed  results,  the  average  will  be  computed  by  averaging  the 
highest  complete  and  lowest  partial. 

g.  In  the  event  that  the  firing  produces  a zone  of  mixed 
results,  computation  of  the  average  will  be  performed  by  using 
the  cumulative  normal  and  the  principle  of  maximum  likelihood. 
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PROCEDURES  FOR  DETERMINING  THE  AVERAGE  (V5Q) 


1.  Establish  a lower  and  upper  velocity  such  that:  ' 

( 

5 

a.  The  probability  of  obtaining  a complete  penetration  at 

the  higher  velocity  is  highly  likely.  ^ 

b.  The  probability  of  obtaining  a complete  pehetrat-ion  at 

the  lower  velocity  is  highly  unlikely.  j 


2.  Fire  the  first  round  at  a velocity  midway  between  these 
two  limits . 

3.  If  the  first  round  results  in  penetration,  fire  the 

second  round  halfway  between  the  first  round  velocity  and  the 
upper  limit  velocity;  otherwise,  halfway  between  the  first  and 
lower  limit  velocity. 

4.  If  the  first  two  rounds  result  in  a reversal  (one  partial, 
one  complete) , fire  the  third  round  midway  between  the  velocity 
of  the  first  two  rounds.  If  the  first  two  rounds  result  in  two 
partials,  fire  the  third  round  at  a velocity  midway  between  the 
second  round  velocity  and  the Upfter  limit  velocity.  If  the 
first  two  rounds  result  in  two  completes,  fire  the  third  round 
midway  between  the  second  round  velocity  and  the 

velocity. 

5.  Succeeding  rounds  are  fired  using  the  "following  rules: 

a.  If  the  preceding  pair  of  rounds  resulted  iii  a reversal 
(one  partial,  one  complete),  fire  at  a velocity  midway  between 
them. 

b.  If  the  last  two  rounds  did  not  produce  a reversal, 
look  at  the  last  four  rounds.  If  the  number  of  completes  and 
partials  are  equal,  fire  the  next  round  midway  between  the 
velocity  of  the  first  and  last  round  of  the  group.  If  the  last 
four  did  not  produce  equal  numbers  of  partials  and  completes , 
look  at  the  last  six,  eight,  etc.,  until  the  number  of  partials 
and  completes  is  equal.  Always  fire  at  a velocity  midway 
between  the  first  and  last  round  of  the  group  you  examined. 

c.  In  the  event  that  conditions  in  b above  cannot  be 

satisfied,  if  the  last  round  resulted  in  a complete,  fire  the 
next  round  at  a velocity  midway  between  the  last  round  and  the 
kmr:  velocity  limit;  otherwise  (last  round  is  a partial)  midway 
between  the  velocity  of  the  last  round  and  the  limit. 
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